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Abstract 

Recent work has characterized the sum capacity of time- varying/frequency-selective wireless interference networks 
and X networks within o(log(SNR)), i.e., with an accuracy approaching 100% at high SNR (signal to noise power 
ratio). In this paper, we seek similar capacity characterizations for wireless networks with relays, feedback, full duplex 
operation, and transmitter/receiver cooperation through noisy channels. First, we consider a network with S source 
nodes, R relay nodes and D destination nodes with random time-varying/frequency-selective channel coefficients 
and global channel knowledge at all nodes. We allow full-duplex operation at all nodes, as well as causal noise-free 
feedback of all received signals to all source and relay nodes. The sum capacity of this network is characterized 
as 5_jfj > _ 1 log(SNR) + o(log(SNR)). The implication of the result is that the capacity benefits of relays, causal 
feedback, transmitter/receiver cooperation through physical channels and full duplex operation become a negligible 
fraction of the network capacity at high SNR. Some exceptions to this result are also pointed out in the paper. Second, 
we consider a network with K full duplex nodes with an independent message from every node to every other node 
in the network. We find that the sum capacity of this network is bounded below by K 2x-2^ "b °0°g(SNR)) and 
bounded above by K ^Z^ + o(log(SNR)). 



I. Introduction 

The recent surge of interest in approximate capacity characterizations of wireless networks has lead to substantial 
progress on several long standing open problems. The capacity of the 2 user interference channel and the capacity 
of certain relay networks have been characterized within a constant number of bits [1], [2]. The sum capacity of 
the X-user time-varying/frequency-selective interference channel (see Figure [TJ was characterized in [3] as 

C(SNR) = y log(SNR) + o(log(SNR)) (1) 

where SNR represents the signal to noise ratio (equivalently, the total transmit power of all nodes when the 
local noise power at each receiver is normalized to unity). If the sum capacity of a network is characterized as 
C(SNR) = dlog(SNR) + o(log(SNR)), then we say that the network has d degrees of freedom (also known as 
multiplexing gain or capacity pre-log). Since, by definition, at high SNR the o(log(SNR)) term is a vanishing 
fraction of log(SNR), the accuracy of such a capacity characterization approaches 100% as the SNR approaches 
infinity. The result that the K user interference network has K/2 degrees of freedom is interesting because it 
shows that at high SNR, every user in an interference network is simultaneously able to reliably communicate at 
a rate close to half of his individual capacity in the absence of all interferers. The result reveals the fallacy of the 
conventional "cake-cutting" view of orthogonal medium access because, essentially, it implies that everyone gets 
"half the cake" (where the cake represents the rate achievable by the user in the absence of interference). The 
achievable scheme of [3] is based on the idea of interference alignment (see [4] and references therein). The key 
to interference alignment is the realization that the alignment of signal dimensions (in time, frequency, space and 
codes) is relative to the observer (receiver). Since every receiver sees a different picture, signals may be constructed 
to cast overlapping shadows at the receivers where they constitute interference while they remain distinguishable 
at the receivers where they are desired. 

X networks are a generalization of interference networks. Unlike an interference network where each transmitter 
has a message for only its corresponding receiver, in an X network every transmitter has an independent message 
for every receiver. Reference [5] studied the S x D X network (Figure [TJ, i.e., a network with S transmitters, D 
receivers and SD independent messages - one message for each transmitter-receiver pair. Using an interference 
alignment based achievable scheme, [5] characterized the sum capacity of the S x D X network as 

SD 

C(SNR) = — D i log(SNR) + o(log(SNR)). (2) 

In other words, the S x D X network has s _f?p_ 1 degrees of freedom. For S = D = K it is interesting to note 
that the degrees of freedom benefits of X networks over interference networks diminish as the number of users, 
K, increases. 

The results of [5] and [3] show that interference alignment suffices to achieve the capacity of wireless interference 
and X networks at high SNR. However, many interesting possibilities are not explored by these scenarios. In general, 
a wireless network can have relay nodes. The nodes may be capable of full-duplex operation so that they can all 
transmit and receive simultaneously and thus co-operate to improve rates of communication. Furthermore, even 
when perfect global channel knowledge is already assumed, noise-free (causal) feedback of received signals may 
have significant benefits in a wireless network. For If -user interference networks, degrees of freedom with relays 
and transmitter/receiver cooperation through noisy channels have been explored in [14] and an outerbound of K/2 
is obtained. Since the results of [3] show that K/2 degrees of freedom can be achieved even without relays and 




Fig. 2. K user full duplex network with (a) K = 2, (b) K = 4 



cooperation, the conclusion is that relays and transmitter/receiver cooperation cannot increase the degrees of freedom 
of interference networks. In this paper, we seek a generalization of the results of [14] from interference networks to 
X networks. In particular, we seek a degrees of freedom characterization for fully connected wireless X networks 
with relays, feedback, transmitter (receiver) cooperation and full duplex operation. 

II. Summary of Results 

There are two main results in the paper. The first result applies to networks whose source and destination nodes 
are disjoint. In other words, if a node is a source node for a message, then it cannot be the destination node for any 
message in the network (and vice versa). In Section [Til] we introduce the S X R x D network - a fully connected 
network with S source nodes, R relay nodes and D destination nodes with full duplex operation assumed at all 
nodes. Since nodes are full duplex, they can all transmit and receive and thus network allows co-operation between 
all nodes through noisy channels. Also included is perfect causal feedback channel of all received signals to all 
source and relay nodes. We show that this network has gS§z^ degrees of freedom meaning that the capacity of 
the network can be expressed as 

SD 

C(SNR) = S + D _ 1 log(SNR) + o(log(SNR)) 



Note that the above approximation is identical to the approximation in equation @. Achievability thus follows 
trivially from the interference alignment based achievable scheme of [5] between the S source nodes and D 
destination nodes. The outerbound is shown in Theorem Q] in Section HVl 

The second result of this paper is for the K user full duplex network considered in Section [V] There is an 
independent message from every node to each of the other K — 1 nodes in the network so that there are a total of 
K(K — 1) messages. All nodes in the network function simultaneously as source, relay and destination nodes. In 
Theorem |2j the sum capacity of this network is bounded as 

C(SNR) > K ^Z2 lo g( SNR ) + o(log(SNR)) 
C(SNR) < K ^Zl ] lo s( SNR ) + o(log(SNR)) 
The achievable scheme is based on interference alignment. Next, we discuss the implications of these results. 

A. Can Relays, Feedback, Co-operation and Full Duplex Operation Improve the Degrees of Freedom of a Wireless 
Network ? 

An interesting implication of the results is that the capacity improvements due to relays, feedback, full duplex 
operation and noisy co-operation become a negligible fraction of the network capacity as SNR increases. Put 
differently, these factors (relays etc.) do not improve the degrees of freedom of wireless networks. Thus, in most 
wireless networks, the search for capacity improvements of the order of log(SNR) ends in interference alignment. 
While the result is obtained for a broad class of networks, it is limited by the underlying assumptions. For example, 
we assume that each node is equipped with only a single antenna, the channel coefficients are time-varying/frequency 
selective and drawn randomly from a continuous distribution whose support is bounded below by a non-zero constant 
(i.e., the network is fully connected), the channel knowledge is global and perfect. Some examples of scenarios 
where degrees of freedom can be improved are listed below. 

1) Relays can improve the degrees of freedom if a network is not fully connected. 

2) Co-operation can increase the degrees of freedom if the cost of co-operation is not accounted for (e.g., in 
genie-aided cognitive radio networks). 

3) Full duplex operation can increase the degrees of freedom if the same node can be the source for one message 
and the destination for another message. 

4) Feedback can improve the degrees of freedom if it is provided to a destination node, in which case it helps 
the decoder by providing, in effect, extra antennas that can be used to null out interference. 

In the remainder of this section, we discuss the above statements in detail. 

B. Relays 

It is easy to construct examples of networks that are not fully connected where the presence of relays increases 
the degrees of freedom. A simple example would be a 3 node network where the channel coefficient between the 
source and destination is zero, so that a non-zero capacity can only be achieved through the relay node. We further 
illustrate the significance of this result by placing it into perspective with some existing results on relay networks. 

The benefits of relays on the degrees of freedom of networks have been considered in [6], [7]. [6] considered a 
single If -antenna transmitting node communicating with a X-antenna receiving node through multiple orthogonal 
hops of distributed parallel relays. Using a simple amplify and forward scheme they showed that the capacity of 




Fig. 3. The parallel relay channel 

this network scales as K log(SNR) + o(log(SNR)). Reference [7] considered a 2 hop parallel relay network with 
K distributed sources and K distributed destinations, with the sources and destinations separated by a layer of R 
distributed relays (Figure [3). Like the interference network, the parallel relay network has K messages, one from 
each transmitter to its unique corresponding receiver. In this setting, the results of [7] indicate that if the relays 
are full-duplex and the number of relays R — > oo, the sum capacity approaches K log(SNR) so that the network 
has K degrees of freedom using an achievable scheme based on amplify and forward. Reference [5] shows a 
similar result for parallel relay networks by viewing each hop as an X network. The achievable scheme of [5] uses 
decode-and-forward and full-duplex relays to achieve ^ K ^^_^ degrees of freedom over this network. Observe that 
by increasing R, we can get arbitrarily close to K degrees of freedom. Thus, if we assume that source nodes are 
not directly connected to the destination nodes, as in Figure [3] then the results of [5] and [7] provide interesting 
examples where full-duplex relays increase the degrees of freedom from K/2 to K. However, the key difference 
between the parallel relay networks in these cases and the model in this paper is that the former network is not fully 
connected since the links from the source nodes to destination nodes are absent. If the parallel relay network of 
Figure[3]is fully connected, i.e., if there are non-zero channel coefficients from all source nodes to all the destination 
nodes, surprisingly, the resulting network has only K/2 degrees of freedom (by the result of Theorem [TJ. In other 
words, the presence of direct links from source to destination nodes in this network reduces the degrees of freedom 
of the network by a factor of half. By artificially imposing the half-duplex constraint on the relays, the relay-aided 
schemes of [5] (and [7]) can provide only an alternate means of achieving K/2 degrees of freedom through a 
2-phase operation. 

C. Cognitive Cooperation 

The benefits of cognitive cooperation in communication networks is currently an active area of research [8], [9], 
[10], [11]. A commonly studied model of cognitive interference networks assumes that certain nodes acquire apriori 
knowledge of certain messages with the aid of a genie. From the degrees of freedom perspective, cognitive message 
sharing can indeed increase the number of degrees of freedom of a network. For example, it is easily seen that in 
the 2 user interference network with 2 messages (see Figure HJ, sharing two messages achieves the full cooperation 
multiplexing gain of 2 [4]. Other examples where cognitive message sharing increases the number of degrees of 




Fig. 4. Two user interference channel with cognitive message sharing, each with 2 degrees of freedom 



freedom of interference and X networks can be found in [10], [4], [12]. 

It is important to note that the models of [4], [10], [12], do not account for the cost of cooperation. For example, 
in Figure |4] (a), the cost of transmitter 2 acquiring message W\ and transmitter 1 acquiring W2 are not factored into 
the problem formulation. References [13], [14] consider the 2 user interference channel where the cost-free genie 
is replaced by physical channels through which the transmitters and/or receivers can share information and find 
that the network has only 1 degree of freedom. Thus, the degrees of freedom benefits of genie-aided cooperation 
disappear when the cost of cooperation is taken into account. Theorem [T] in this paper extends this insight to the 
general class of X networks. 

D. Full Duplex Operation 

The fact that full duplex operation improves the number of degrees of freedom can be easily observed in the 
2 way 2 user point-to-point channel which has 2 degrees of freedom (Figure |2). In a more general network with 
K nodes and a message from every node to every other node (Figure |2), full duplex operation can be shown to 
increase the number of degrees of freedom. For example, consider a network with K nodes. In Theorem [2] we 
show that the capacity of this K node full duplex network satisfies 

K j* ~ X) log(SNR) + o(log(SNR)) < C full _ duplex (SNR) < K ^~] ) log(SNR) + o(log(SNR)) 
ZA — Z ZA — o 

If we assume half duplex operation, then the optimal arrangement is with K/2 nodes behaving as transmitters 

K 2 
4K-4 



and K/2 nodes behaving as receivers to form a K/2 user X network. This network has 4 5_ 4 degrees of freedom 



so that we can write 

Chalf -duplex (SNR) = log(SNR) + o(log(SNR)) 

4A — 4 

Clearly full-duplex operation increases the degrees of freedom of a network with K nodes. 

Note that the S x Rx D network of Theorem Q] includes full-duplex operation in its model. The difference from 
the K user full duplex network of section [V] and the S x Rx D network of Theorem Q] is that in the latter, nodes 
that are message sources are not destination nodes. 

E. Feedback 

While we know that perfect feedback does not increase the capacity of a memory-less point-to-point channel, 
feedback has been shown to increase the capacity of the multiple access [17], [18] and broadcast [15] channels. 



#3,2 Wl ' 3 




Fig. 5. A network where feedback increases degrees of freedom 

However, the issue addressed here is whether feedback can increase the degrees of freedom of a wireless network. 
We show in Theorem [T] that even perfect feedback to the source-nodes and relays does not increase the degrees of 
freedom of a fully connected network with S source nodes, D destination nodes and R relays. We can however 
construct a scenario where feedback improves the degrees of freedom of a network. To see this consider a 3 node 
full duplex network with 3 messages as in Figure [5] If there is no feedback in this 3 node network, the number 
of degrees of freedom of this network is upperbounded by 2 - the degrees of freedom of a 3 node full-duplex 
network discussed in the previous subsection. Now, if we include feedback in this network as shown in Figure [5] 
we can show that 3 degrees of freedom are achievable, with each message achieving 1 degree of freedom. To see 
this, consider node 1. Let the channel gain for the signal from node i to node j be equal to Hjj and Zj be the 
AWGN term at receiver j. This received symbol at this node is equal to H12X2 + -^1,3X3 + Z\. Also, the node 
obtains information of + Zi through feedback from node 2. Using the feedback, node 1 can zero-force 

the interference from node 2 and thus obtain 1 degree of freedom for the message W1.3. Similarly the remaining 
two messages can each achieve 1 degree of freedom so that 3 degrees of freedom are achievable over the network. 
Thus, feedback increases the degrees of freedom of this network. 

The reason feedback helped the network of Figure [5] is that it provided a decoder with an extra antenna which 
can be used to cancel interference. Therefore, feedback can increase the degrees of freedom if it is provided to a 
decoding node. 

III. System Model for an S x R x D node X Network 

Consider an S x R x D node network, i.e., a network with S + R + D nodes where nodes 1, 2, ■ • • , S are 
sources, nodes S + 1, S + 2, • • • , S + R are relays, and nodes S + R+l,S + R + 2, ■ ■ ■ ,S + R + D are 
destination nodes (see Figure |5J. Following the definition of an X network [5], for all j £ {1, 2, • ■ • , S} and for 
all z £ {S + R + 1, S + R + 2, • • • , S + R + D}, there is an independent message Wij to be communicated from 
source node j to destination node i. 

Full duplex operation is assumed so that all nodes are capable of transmitting and receiving simultaneously. The 




Fig. 6. The S X R X D network 



input and output signals of the S x R x D node network are related as: 

S+R+D 

Yi(n) = HijinjX^n) + Zi(n), i e {1, 2, • ■ • , S + R + D}, n e N (3) 

i=i 

where, at the n discrete time slot, Xj(n) is the symbol transmitted by node j, Yi(n) is the symbol received by 
node i, Hi j(n) is the channel from node j to node i and Z^n) is the zero mean unit variance additive white 
Gaussian noise (AWGN) at node i. We use the following notation, 

X? 4 {X i (l),X i (2),---,X i (n)} (4) 

Similar notation is used for output signals and the additive noise terms as well. 

The channel coefficients Hi j (n), Vi, j £ {1, 2, • • • , S + D + R} are known a/jr/orjj] to all nodes. We assume the 
channel coefficients are time-varying/frequency-selective with values drawn randomly from a continuous distribution 
with support bounded below by a non-zero constant. Thus, all channel coefficients take non-zero values and the 
network is fully-connected. The AWGN terms Zi (n) have unit variance and are independent identically distributed 
(i.i.d.) in time and across nodes. 

Perfect (noise-free) and causal feedback of all received signals is available to all source and relay nodes, but not 
to the destination nodes. For codewords spanning N channel uses, the encoding functions are as follows, 

fi,n (Ws+R+l,i,Ws+R+2,i, ' ' ' , Ws+R+D,i , Y™' 1 , Y£~ l , ■ • • , Ys+R+d) ) * ^ {1; 2 , • • • , S*} 

Xi(n) = <; f hn (Y?-\Yr\ Ys+k+o) , i £ {S + l,S + 2, - ■ ■ ,S + R} 

hnlyp' 1 ), i£{S + R+l,--- , S + R + D} 

'Thus, we also show that non-causal channel knowledge does not increase the degrees of freedom. 



for n = 1, 2, ■ • • , N. In other words, the signal transmitted from a source nodes at time n is completely determined 
by all the messages originating at that source node and the received signals of all the nodes upto time n — 1 
(causality condition). The signal transmitted by a destination node at time n can only depend on all the received 
signals at that node upto time n — 1. This is because the destination nodes do not receive feedback of other nodes' 
received signals. The signal transmitted from a relay node can only depend on the received signals of all the nodes 
upto time n — 1. 

The decoding functions are as follows, 

Wij = g l , 3 (Y 1 N ) ,ie{S + R+l,S + R + 2,--- ,S + R + D},j e {1,2,- ■ ■ ,S} 

Thus, a destination node can only use its own received signal to decode all its desired messages. The probability 
of error is the probability that there is at least one message Wij that is not decoded correctly, i.e. Wij ^ Wij for 
some 

The total power across all transmitters is assumed to be p per channel use. We denote the size of the message 
set by |Wj )-7 -(p)|. Let Rij(p) = loe ^ w ^^ p ^ denote the rate of the codeword encoding the message Wij, where the 
codewords span N slots. A rate-matrix [(Ri,j(p))] is said to be achievable if messages Wij can be encoded at rates 
Rij(p) so that the probability of error can be made arbitrarily small simultaneously for all messages by choosing 
appropriately long N. 

Let C(p) represent the capacity region of the S x Rx D node network, i.e., it represents the set of all achievable 
rate-matrices [(Rji(p))}. The degrees of freedom region of the S x R x D node network is defined as 

,SD . wr/-„. M r- iaSD 



2?=|[(d 4J )]eM^:V[(a lJ )]eMf 

S+R+D S 



a i,jdjj < lim sup 

i=S+R+l 1 = l " p ^°° 



S+R+D S 



IV. Degrees of Freedom of the S x Rx D node X network 

Theorem 1: Let 

V out = |[(dij)] : V(u,«) e {1,2- • -5} x {S + R+l,S + R + 2,--- ,S + R + D} 

S+R+D S 



log(p) 



O -\-lX-\-LJ O N 

d q .u + ^2 d v, P - d v , u < i [ 

q=S+R+l p=l ' 



Then T> C D out where T> represents the degrees of freedom region of the S x Rx D node X network. Furthermore, 
the total number of degrees of freedom of the S x R x D network can be upperbounded as follows 

S S+R+D 

max > > di 4 < 

^^hiM+i " S+D - 1 

Equivalently, the sum capacity C(p) of this network can be bounded as 

cn 

C(p)< s + D _ i log(p) + o(\og(p)) 
Proof: To prove the theorem, all we need to show is that for any (p, q) G {1,2, . . . , S 1 } x {S + R + 1, S + 
R + 2,...,S + R + D} 

S+R+D S 

di,p + ^2 ^I'i ~~ ^i-p — ^ 

i=S+R+l j=l 



Feedback 




Feedback 



Fig. 7. 4 user X network 



In other words, for all messages that either originate at node p or are intended for node q, the total number of degrees 
of freedom cannot be more than one. For convenience, we will show the inequality for (q,p) = (1, S + R + D). 
By symmetry, the inequality extends to all desired values of p, q. We therefore intend to show that 

S+R+D S 

22 di,i + 2_, d s +B.+D,j - ds+R+D,i < 1 

i=S+R+l j=l 

To show this, we first eliminate all the messages that are not associated with either source node 1 or destination 
node S + R + D, i.e., we set Wij — <fi, (i — (S + R + D)) (j — 1)^0. Since we are only seeking an outerbound 
on the rates of a subset of messages, it is important to note that eliminating a message can not hurt the rates of the 
remaining messages [4]. Now, we transform the original S x Rx D node network with single antenna nodes into a 
2x0x2 node network, i.e., an X network with 2 source nodes, zero relay nodes and 2 destination nodes where one 
source and one destination have multiple antennas (see Figure|7]l- This is done by allowing full cooperation between 
the S—l source nodes 2 , • • • , S and the R relay nodes S + 1 , S + 2, • • • + so that they effectively become one 
transmitter with S + R — 1 antennas. Similarly, destination nodes S + R+1, S +R + 2, ■ ■ ■ , S + R + D — 1 are also 
allowed to perfectly cooperate so that they form one receiver with D — 1 antennas. Again, note that allowing the 
nodes to cooperate cannot reduce the degrees of freedom region and therefore does not contradict our outerbound 
argument. We represent the resulting 4 node X network (Figure [7]) by the following input-output equations. 

4 

Yi(n) = ^Hi^njX^ + Ziin), is {1,2,3,4} (5) 

where 

Y x {n) = Y x {n) 

Y 2 (n) = [Y 2 (n) Y 3 (n) ■■■ Y s+R (n)] T 

Y 3 (n) = [Y s+R+ i(n) Y s+R+2 (n) ■■■ Y s +R+D-i(n)} 

Yi{n) = Ys+R+D(n) 



Thus, nodes 2 and 3 act as multiple antenna nodes with S + R—l and D — 1 antennas respectively. Xi(n), Zi(n) 
are also defined in a corresponding manner for i S {1,2,3,4}. The definition of the channel coefficients Hij(n) 
is clear from equations (01 and (0, and from Figures [6] and [7] Multiple messages that have the same source and 
the same destination are combined in the 4 node X network as follows: 

W a ,i = [Ws+r+i,i Ws + r+2,i ■ ■ ■ W s +r+d-i,i] (6) 

W 3 ,2 = (7) 

W 4A = Ws+r+da (8) 

W4,2 = [Ws+R+D,2 Ws+R+D,3 ' ' ' Ws+ii+£>,s] (9) 

Over this X network, the encoding functions are as follows 

Xi(n) = /Ln^i,^!,^^" 1 ^" 1 ,^ 1 ) (10) 

^a(n) = 7 2 ,„(w 7 4,2,^ 1 ,Fr 1 ,Fr 1 ,Fr 1 ) (11) 

X 3 (n) = 7 3 , n (Y 7 r 1 ) (12) 

Xiin) = l^iYT 1 ) (13) 
and the decoding functions are the following: 

W 3jl = 93,1 (^f) (14) 
= 54,i (Ff) (15) 

W 4 ,2 = 54,2 (/f) (16) 

The rates and the degrees of freedom region of this network are defined in a manner similar to the S x R x D 
network. 

For this 4 node X network, it follows from Lemma Q] (stated below) that: 

^3,1 + <h,i + d^ 2 < 1 

where dij represents the number of degrees of freedom corresponding to message Wij. Using equation ©-(O, 
we can re-write the above outerbound in terms of degrees of freedom of the S x R x D network as follows. 

S+R+D S 

^ di,l + ds+R+D,j - ds+R+D,l < 1 
i=S+l + R. j=l 

By symmetry, the above inequality implies that 

S+R+D S 

^ ^ di.p ~\~ ^ ^ dq. j dq p < 1 

i=S+l+R j=l 

The outerbound on the degrees of freedom region V is therefore shown. Summing all inequalities of the above 
form over all (p, q) 6 {1, 2, . . . S} x {S + R + 1 . . . S + R + D}, the bound on the total number of degrees of 
freedom can be obtained ■ 
In the above proof we used the following lemma. 




Fig. 8. The outerbound argument for the 4 user X network - Lemma [T] 



Lemma 1: . In the 4 node X network described by equations (|5]l,(fT0l)-(fT3]), (fT4l-(fl6]i and Figure [Jj the total 
number of degrees of freedom can be upper-bounded by 

max d 3 i + d 4 2 + d 4 3 < 1 

v x 

where T> x represents the degrees of freedom region of this 4 node X channel 
Define 

Ui(n) = JT<,i(n):Xi(n) + Z<(n), i = 1,2,3,4 

In order to prove Lemma Q] we need the following result 

Lemma 2: In the 4 node X network of Figure |7j and equations (l5t.fT0l-lfT3t. (fT4l-(fl6]l. the following three 
statements are true. 

Si(n)-. x\ ^w 3 .i,w 4A ,w 4 ,2,TTr\iTr\ur\u2~ 1 

S 2 (n): XlXlXl ^W 4 , 2 ,uT\u n 2 -\uT\uV 
S 3 (n): Y^YlTzTl - W 4 , 2 , 1%, ^1X1 

where A <— B means that the value of A is completely determined by the knowledge of the value taken by B. 
A proof of the above lemma is placed in Appendix U We now proceed to a proof of Lemma Q] 

A. Proof of Lemma [JJ 

Let a genie provide the messages W 4j \ 1 W 4t2 and Ui(n), U 2 (n), 1/3(12), U 4 n) to node 3 at channel use n 6 N. 
Note that Lemma [2] implies that the node can construct Yi(n),i — 1,2,3,4 using this side information from the 
genie. Also note that in the genie supported 4 node X network in Figure [8] node 3 is not explicitly shown to 
receive Y^n) because it is already contained in the information available to node 3. 

Next we find outerbounds on the rates in the genie supported 4 node X network. Using Fano's inequality, we 
can write 

NRzAp) < I(W 3Xl W 4:1 ,W 4 ^U 4 ,U2,U3,U 4 ) + Ne N 



< I{W 3X , Uf, U%, , U 4 \W 4A ,W 4 , 2 ) + Ne N 

< ff(L/f ,Z/f ,U" ',f7f|W4,i,W4,2)- H(T7f \uZ,uZ,U?\W 3 ,i,W4,i,W4,2)+Ne N (17) 



Ti T 2 

Simplifying the terms, 

N 

t 2 = ^H{ux{n),u2{n),us{n),u 4 {n)\w^w 

n=l 

(a) N 

> ^i7(F 1 (ri),F 2 H,F 3 (n),I/4(n)|W3 a ,Tr4a,W4,2,Fr\c7r\^\^r\^iW^ 

n=l 
iV 

> ^ff(Z 1 (n),Z 2 (n),Z 3 (n),Z 4 H) 

n=l 

JV Mi+M 2 +Af 3 + M 4 

^ E E 

n— 1 2—1 

> N(M 1 + M 2 + M 3 + M 4 )log(2ne) (18) 

where M, represents the number of antennas at node i in the X network. Inequality (a) uses the fact that conditioning 
on X\(n) reduces entropy. 

N 

rfa — 1 T^n— 1 -rrrpfl—l r—pTl—l 



n=l 

JV 

n=l 
iV 

+ ^ if (Ui (n) , C7 2 (n) , I7 3 (n) | W 4 ,i , W 4 , 2 , C/" _1 ,^2 _1 1 , 1 ,^4 (n) ) 

n=l 

AT 4 

( = } Yl H ^ w + E n^Xj (») 1^4,1, w 4 , 2 , c/r 1 , ur 1 , ^r 1 , ^r 1 ) 

n=l j=2 
iV 

+ ^H(U 1 (n) , U 2 (n) , t7 3 (n) | W 4 ,i , W 4 , 2 , , U 2 _1 , 1 ,T/2~ 1 , t7 4 (n) ) 

n=l 

AT 

i £ ff ( F 4 (n) | W 4 ,i , W 4 , 2 , t/T 1 ,^2 " 1 , 1 , 1 ,Y 4 (n - 1) ) 
n=l 

5^ ff (Fi (n) , C/2 (n) , U 3 (n) | F 4 ,i , W 4 , 2 , \ \ T%~ \ lf~ 1 ,U 4 (n) ) 



(d) 



n=l 

N N 



< J2 H (Xi(n)\W 4A ,W 4 , 2 ,Y 4 (n - 1)) + £ H{U x {n), U 2 (n), U 3 (n)\U 4 (n)) 

n—l n—1 

N 3 

< H(Y^\W^iW^2) + ^^H^i{n)\U4{n)) (19) 

n— 1 i— 1 

Equality (b) uses statements 5*i(n), ^(n) of Lemma [2] (c) uses S^n) of Lemma [2] Inequality (d) uses the fact 
that conditioning reduces entropy to bound both terms of the summand on the right hand side. 



Now, we can bound the second term in T\ as follows 

H(U t {n)\U 4 {n)) = ff(Fi,i(n)Xi(n) + Z i (n)\H il (n)X 1 {n) + Z s+ R+ D (n)) 

(e) M< 

< ^^(jfJlXifa) + Zf ] (n) |ff 4) i WX x (n) + Z 4 (n)) 



< f:fio g fi+ - ^#^- l+1 o g (2 7re ) 



< 



fel l 1+1*4,11 

53 log 1 + -LMJ 1 + ATM, log(2^e) (20) 



1+I^4,1| 2 P1 



_[j] [j] 

where in (e), Z i and H i 1 represent the noise and channel gain terms associated with the jth antenna at node i 
and Mi represents the number of antennas at node i (Note that Mi — A/3 = 1 ). Inequality (/) above holds because 
of Lemma 1 in [13]. Note that pi represents the power expended at transmitter 1. Now, notice that the bound of 
(l20l implies that as long as H 44 > 0, the term ^% („)|(j 4 ( n ) is upper-bounded by a constant for all values of input 
power p. Therefore, using equation (l20l and then combining $1% , ( TT~8b and ( TTTb we can write 

i? 3 ,i(p) < ^#( F f 1^4,1,^4,2) + 0(1) (21) 
Now, using Fano's inequality to bound rates of messages intended for node 4, we can write 

R iA (p) + R±Ap) < jjI(W 4tl ,W 4}2 ;Y 4 ) + e N 

1 N I jV 

= -H(Y 4 )--H(Y 4 \W iA , W^) + e N 



1 3 _ j _ 

-(^HijXj) H(Y 4 \W 4A ,W 4 , 2 )+e, 



u J ' N 

i=i 

1 _/v 

= log(p) + oQog(fi)) - J^H(Y 4 \Wi,i, Ww) + e N (22) 

where the final inequality can be derived from the standard upper-bound on entropy using Gaussian variables. 
Adding up the upperbounds ( 1211 and ( f22l . we have 

R 3t i{p) + R 4 s(p) + R 4 , 2 (p) < log(» + o(log(p)) + e N (23) 

Thus, the total number of degrees of freedom of the 4 node X network described is upper-bounded by 1 so that 
we can write 

max d,3 1 + d 4 2 + d 4 3 < 1 

m 

Note that the above lemma holds even if the X network is not fully connected long as H 4 i is non-zero. If H 4i i is 
equal to zero,the argument fails because in equation ( f20b . H(Ui(n), 1/2(11), 1/3(71) |L?4(n)) cannot be upperbounded 
by o(log(j(?)). All other inequalities hold for arbitrary channel co-efficients. 

V. K user Full Duplex Network 

In this section, we derive bounds on the degrees of freedom region of the A'-user full-duplex network (see 
Figure [9] (a)). Consider a fully connected network with K full-duplex nodes 1,2, ... K. In this network assume that 



there exists a message from every node to every other node in the network so that there are a total of K(K — 1) 
messages in the system. The message from node j to node i ^ j is denoted by Wjj. Let Hij(n) represent the 
channel gain between nodes i and j corresponding to the nth symbol. The channel gains satisfy Hij(n) = Hj^(n) 
and Ha = 0. As usual, all nodes have apriori knowledge of all channel gains. The input-output relations in this 
channel are represented by 

K 

Yi{n) = J2 H ^( n ) X j( n ) + Z i( n )> iS{l,2...K] (24) 

j'=i 

where Yi(n), Xi(n), Zi(n) represent, respectively, the received symbol, the transmitted symbol and the AWGN term 
at node i. For codewords of length N, the encoding functions in this network are defined as 

Xt(n) = fi, n (Wi,i,W2,i, Wi-i ti , W i+ x,i, . . . WicuY?- 1 ) (25) 

and the decoding functions are defined as 

W jt i = //,„•: V ; v . Wi d , W 3J , • ■ • , Wj-u,W j+1 j, . . . W Kd ), Vi + j. (26) 

The main result of this section is an approximation of the capacity of the K user full duplex network as follows. 
Theorem 2: The capacity Cfd(p) of the K user full-duplex network is bounded as follows 

CMP) > log ^ + °( log ('°)) 

C fd (p) < K 2K^3 log ^) + °( log ^) 
The outerbound of the above theorem is proved in Section IV-AI A discussion of the innerbound is placed in 

Section IV-BI A formal proof of the innerbound is placed in Appendix [II] The proofs of the both the outerbound 

and innerbound need the lemma below, which transforms the K user full duplex network to another network whose 

source nodes are different from destination nodes. 

Lemma 3: The K user full-duplex network is equivalent to a network with K half-duplex source nodes and K 
half-duplex destination nodes with the following properties 

1 ) The input-output relations are described as 

K 

Y t {n) = ^Hi^X^ + Ziin), ie{l,2...K} 



3 = 1 



2) 



Hij = //,.,. :;../ 1.1'... A 



Note that this means 



H iti = 

3) There are K(K — 1) messages in the system, denoted by Wj t i,i ^ j. These messages are denoted by 

Wj,i = II.,,.,. 7/ - ./•'../ ' {1.2.... A] 

4) Encoding function of the form 

Xi(n) = fi, n ( Y r~\ Wi,i,W 2 ,i . .. Wi-x,i,W i+hi . ..W K ,i) (27) 





Fig. 10. 4 node network with sum capacity not smaller than the sum capacity of the 4 user full duplex network 



5) Decoding function of the form 

U = gup?, Wij, m,i . .M, .H • ..WK,j),j + i (28) 
Note that the encoding and decoding functions imply that 

« A genie provides receiver j with apriori knowledge of all messages at source j i.e. Wi,j,Vi = {1,2,... K}—{j} 

m There is perfect feedback from destination K to source K. 
By comparing encoding equations d25l >. ( f27l > and decoding equations (|26| |. (|28T >. the lemma can easily be proved, 
i.e., we can show that any encoding scheme that can be implemented on the K user full duplex network, can also 
be implemented on network described in the above lemma and vice-versa. 

We now proceed to prove the outerbound of Theorem |2] 



A. Proof of Outer-bound of Theorem [2] 

Note that the outerbound of Theorem [2] is equivalent to the following statement 

K(K - 1) 



< 



2K -3 



where dfd represents the number of degrees of freedom of the K user full duplex network. 
If Vfj is the de grees of freedom region of the K user full duplex network, we show that 



E 



E 

ie{l,2,3,... g-1,5+1) 



dq. v < 1,YP^ q 



■K} 



for all (di t j) S I? Summing inequalities of the above form over all (p,q),p ^ q gives the desired outerbound. 
It is enough to show the inequality for p = 1 and q = K. The inequality extends to all other values of (p, q) by 
symmetry. Therefore, we intend to show 

E dj- 1 + E di ' K ~ dRi - 1 - 

j&{2,3,...K} ie{l,2,3,...if-l} 

The above inequality is shown for the equivalent network described in Lemma [3] To show the above inequality, we 
first set Wij = 0, (i—K)(j — l) ^ 0. With these messages set to null, there are no messages intended for destination 
node 1 and therefore, it can only help the capacity of the network through feedback of the received symbol to node 
1. Therefore, we can delete side information of messages Wj t \,j = 2,3.. .K at destination 1 without affecting the 

converse argument. We now allow destination nodes 1 K — 1 to co-operate with each other, so that they form 

a single multi-antenna destination node. Similarly, we allow source nodes 2 ... K to cooperate with each other so 
that they form a single multi-antenna source node. Note that allowing for co-operation does not reduce capacity and 
therefore can be used in the converse argument. The network is thus transformed to a 4 node X network (Figure 
[Tot with input-output relations described by 

2 

J2H l . ] (n)X J (n) + Z l (n), ze{3,4} (29) 



Yi{n) 



3=1 



where 



Y K -i{n) 



(30) 
(31) 



Y 2 (n) = \Y 2 {n) 
Y 4 (n) = Y K (n) 

Nodes 2 and 3 act as multiple antenna nodes, each with K — 1 antennas. Xi(n),Zj(n) are also defined in a 
corresponding manner for i = 1,2, j = 3,4. The definition of the channel coefficients Hi t j(n) is clear from 
equations (l29l and (l24l . and from Figures [9] [10] and [7] Note that H4.1 = Hka ^ since we have p ^ q. The 
messages in this 4 node X network are defined as follows 



W 3 ,i 
^3,2 

W 4 ,i 

W4,2 



W 2 ,l W 3 ,l 



W K - 



1.1 



Wka 

W K ,2 W 9i3 • • • W K ,K-1 

The encoding and decoding functions, for codewords of length K over this 4 node X network are defined as 



(32) 
(33) 
(34) 
(35) 




Fig. 11. Innerbound for the 4 user full duplex channel - conversion to interference channel with 4 messages 

x 2 (n) = / 2 ,„(w 4 , 2 ,Fr 1 ,Fr 1 ) 

^4,i = g 4}i (Y"),i = 1,2 
^3,1 = 534(^,^4,2) 

We allow multi-antenna node 3 to have apriori knowledge of message W31 through a genie. We also allow perfect 
feedback from destination nodes 3,4 to source nodes 1,2. Note that the side information through feedback and 
genie in the 4 user network constructed is stronger than the information at the corresponding nodes in the original 
K user network. Since we are only providing an outerbound on the degrees of freedom region, the argument is not 
affected. Now, over this network, we claim that Lemma [T] holds. The 4 node X network differs from the network 
of Lemma [T] in two aspects: 

1) In the X network constructed in this section, node 3 has information of message W^,2 apriori. In the network 
of Lemma Q] node 3 does not have this side information. 

2) The network constructed here is not fully connected since certain channel co-efficients are equal to zero. 
However H 41 is non-zero. 

1) does not affect the converse argument because the proof of Lemma Q] begins with the genie providing information 
of W4.2 (and W^i) to node 3 (see figure [8}. 2) does not affect the converse argument because, as mentioned towards 
the end of section ITVl the proof of Lemma [T] holds as long as H^.x 0. Therefore, the bound of Lemma [T] holds 
for the 4 user network in consideration here i.e. the network defined by equations < f29b and we can write 

^3,1 + ^4,1 + cLi,2 < 1 
K K-l 

=> do + d K ,j ™ d K ,i < 1 
1=2 j=i 

where di j represents the number of degrees of freedom corresponding to message Wij. The desired result follows 
from the final equation above. ■ 

B. Inner-bound of Theorem [2] 

Note that the innerbound of theorem [2] is equivalent to 

K(K-l) K 
dtd > — = — 

1 2K - 2 2 

where dfd represents the number of degrees of freedom of the K user full duplex network. The innerbound 
is shown using an achievable scheme based on interference alignment over multiple symbol extension of the 



channel, much like [5]. The argument is placed in appendix [II] However, here we consider the special case of the 
K user full duplex channel where the reciprocity constraint on the channel is relaxed, i.e. the case where Hij 
is independent of Hj i. In this case, the innerbound can be shown using the fact that the K user interference 
channel has K/2 degrees of freedom. To see this, over the equivalent K user full duplex channel of Lemma 
|3] we set Wij = (f>,V(i — j) = Z(mod K),Vl ^ 1. In other words, the only messages that are not set to null 
are W1.2, ^2,3, ■ ■ ■ Wk-i,k, Wk,i (See Figure [TTJ. Note that with these messages, the channel is an interference 
channel with certain interfering channels (Hij) set to zero. Since interference can only hurt the capacity of a 
user, setting certain interference channels to zero can only increase the capacity. Therefore, the equivalent K user 
full duplex network performs atleast as well as the K user interference channel and therefore has at least K/2 
degrees of freedom. Note that this argument does not hold if Hi j = Hjj since the achievable scheme over the 
interference channel in [3] requires each channel co-efficient to have a continuous probability distribution, given all 
other channel co-efficients. (If the channels satisfy the reciprocity property, then a particular channel co-efficient is 
deterministic if all other channel co-efficients are given). However, we show that the innerbound is still valid and 
the achievable scheme is presented in Appendix HI1 

VI. Conclusion 

We characterize the capacity of a fully connected network with S source nodes, R relays and D destination nodes 
with full duplex operation and feedback. We also provide bounds on capacity approximations within o(log(SNR)) 
of the K user fully connected network in which there is a message from every node to every other node. The lower 
and upper bound provided are tight if K is large. Apart from the small gap between the bounds of the K user fully 
connected network, this work effectively solves the degrees of freedom problem for a fairly large class of wireless 
networks with time-varying/frequency-selective channel gains. 

A major implication of our result is that in fully connected networks whose source nodes are different from 
destination nodes, the techniques of relays, perfect feedback to source nodes, noisy co-operation and full duplex 
operation can only increase the capacity upto o(log(SNR)) bits. In such networks, the search for improvements in 
capacity of the order of log(SNR) ends in interference alignment. In other words, the mentioned techniques (relays 
etc.) cannot improve the degrees of freedom of wireless networks except under certain special circumstances listed 
below. 

1) Relays can increase the degrees of freedom of networks that are not fully connected 

2) Feedback can increase the degrees of freedom of a network, if it is provided to a decoding node. However, 
feedback to source/relay nodes does not increase the degrees of freedom of wireless networks. 

3) Full duplex operation can increase the degrees of freedom of wireless networks if certain source nodes also 
behave as destination nodes i.e. the set of source nodes and the set of destination nodes are not disjoint. 

4) Cognitive co-operation can increase the degrees of freedom of wireless networks if we do not account for the 
cost of a cognition (for example, the cost of acquiring a message) at a node. 

It must be observed that our result does not necessarily discourage the use of relays, feedback, co-operation and 
full duplex operation in real communication scenarios. In fact, not all wireless networks are fully connected under 
realistic transmit signal powers. Furthermore, in several communication networks, source nodes act as destination 
nodes as well. Importantly, the result of this paper provides an insight into the type of networks which are most likely 
to benefit from these techniques, especially at high SNR. Furthermore, our result does not preclude huge benefits in 



terms of capacity at low or mid-range SNR from the mentioned techniques which continues to be an important area 
of research in wireless communications. Another important limitation of our results is the assumption of time-varying 
and/or frequency selective channel gains for the achievability schemes based on interference alignment. However, 
the outerbounds of Theorem Q] and Theorem [2] are fairly general and hold for all fully connected networks whether 
the channel coefficients are time-varying or constant. 

Appendix I 
Proof of Lemma[2] 

We use induction principle to prove Lemma [2] First, we argue that Sx(l), 62(1), are At the first channel 
use (n — 1), because there are no prior received signals, the destination nodes 3,4 have no useful information to 
transmit. Therefore, without loss of generality X3(1),X4(1) = 0. 

Xi(l) = 71,1(^3,1.^4,1) (36) 
^2(1) = 72,1(^4,2) (37) 
F,(l) = C7 i (l)+ff i>2 (l)X 2 (l), ie {1,2,3,4} (38) 

Equations d36i >. d37l > imply that the statements 5 X (1),S2(1) are true. d37l i. together with (l38l implies that Ss(l) is 
true as well. Thus, the result of Lemma [2] holds for n = 1. For n = 2, 

X x (2) = 7 l!2 (W 3 ,i,W 7 4a,F 1 (l),F 2 (l),F 3 (l),F 4 (l)) (39) 
X 2 (2) = 7 2!2 (W 4 , 2 ,F 1 (i),F 2 (l),F 3 (i),F 4 (l)) (40) 

Xj(2) = /^(F^l)), j £{3,4} (41) 
4 

F(2) = Ui(2) +^H iJ {2)X j (2), i£ {1,2,3,4} (42) 

Equation ([39) and 5 X (1) imply that £ x (2) is true. gO), (gB and 5 2 (1) imply that 5 2 (2) is true. 5 X (2), 5 2 (2) and 
(l42l together imply that 5 3 (2) is true as well. Thus, Si(n), i = 1,2,3 hold true for n = 2. Following the induction 
argument, suppose that Si(n),i — 1,2,3 are true for n = k — 1. Then, 

Xi(k) = f 1 , k (W 3 , 1 ,W iA ,Y k 1 - 1 ,Y k 2 - 1 ,Y k 3 -\Y k - 1 ) 

X 2 (k) - f 2 , k (w4, 2 y i -\Y k -\Y k -\Y k - 1 ) 

Xj(k) = 7 h ,(Tj ')• j £ {3, 4} 
4 

F(fc) = U l (k)+Y / H l . ] (k)X J (k), ie {1,2,3,4} 

J=2 

The above equations, along with S\{k — l),S' 2 (fc — l),S%{k — 1) imply that S\(k), S 2 (k), 5 3 (fc) are true. The 
inductive assumption implies that Si(n), i = 1,2,3 hold for all values of n. 

Appendix II 

Proof of innerbound of Theorem[2]: Achievable scheme 

The achievability proof is based on interference alignment over the channel described in lemma [3] (Figure |9jb)). 
Since many of the details are identical to [5], we focus here on the unique aspects of this proof. 



Let r = (K — 1){K — 2). We show that K(K — l)n r degrees of freedom are achievable over a 

fin = (K - 1) ((n + l) r + n r ) 

symbol extension of the channel for any n G N thus implying the desired result. Over the extended channel, the 
scheme achieves n T degrees of freedom for each of the K(K — 1) messages Wij,j ^ i. The signal vector in the 
extended channel at the j th user's receiver can be expressed as 

M 

Y j (K) = J2H j , i (K)X i (K) + Z j 

where Xj is a/i„xl column vector representing the [i n symbol extension of the transmitted symbol X i7 i.e 

Xi(fJ, n K+l) 
Xi(Hn(K+l)) _ 

Similarly Yj and Zj represent /j, n symbol extensions of the Yi and Zi respectively. H,j is a diagonal fj, n x /U„ 
matrix representing the [i n symbol extension of the channel. Similar to the interference alignment based achievable 
schemes of the interference and X channels, the message Wij is encoded at transmitter j as n T independent 
streams so that Xj is 

x, («) = E ( E xg] («) v g («) = J2 v ^ («) 

»={l,2...Ji-}-{j} m=l i={l,2,...AT}-{j} 

The received signal at the A:" 1 receiver can then be written as 

M N 

Y fc ( K ) = ^H fe , i (K)(^V j , i ( K )x^( K ))+Z fe (K) 
»=i j=i 

We now need to ensure that at receiver j, the (K — 1)(K — 2) interfering spaces Vk,i, k ^ i,k ^ j, i ^ j lie in 
a (K — l)(n + l) r dimensional space so that (K — l)n r desired spaces V^j, i G {1, 2 . . .} — {j} can be decoded 
free of interference from a [i n dimensional space. To do this, we first set 

Then, we design Vj, j = 1,2. . .K so that they satisfy the interference alignment equations below. 

HijVfc ^Ifc,V{(*,j,fc) :i^k,kjt (43) 

such that rank(Ifc) = (n + l) r where P -< Q implies that the span of the column vectors of P lies in the vector 
space spanned by the column vectors of Q.. Note that for a fixed k, there are T = (K — 1)(K — 2) relations of the 
above form. We first generate /i„ x 1 column vectors Wfe, k = 1, 2 . . . K so that all the entries of are drawn from 
any continuous distribution independently from each other and independently from all other entries in wj , I ^ k. 
The rest of the proof is similar to the achievable scheme for the X channel presented in [5]. It is easy to observe 
that the dimension of the interfering space at receiver k space is equal to the dimension of the space spanned by 
all column vectors of matrices ^ k which is equal to (K — l)(n + l) r . The only difference from the model 
in [5] is that here, we have Hjj = H^j whereas, in [5] the matrix H^j is independent from Hj^. However this 



Xi(/«) = 



difference does not affect the construction of vectors satisfying the desired interference alignment relations d43l ). 
The difference does not affect the argument that at any receiver, the signal space is linearly independent with the 
interference space since the argument only depends on wj. being independent of w/ for I ^ k. The only condition 
that needs to be verified is that all the desired streams of at receiver k are linearly independent of each other. In 
other words, all that needs to be shown is that the column vectors of 



are linearly independent. The linear independence follows from the fact that the construction of satisfying the 
relations of d43b is independent of both Hk,i and Hj^ for i ^ k. Again, the reader is referred to the achievable 
scheme in [5] for a formal proof of the same. 
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